The neural basis of naturalistic semantic and social cognition.

Decoding social environments and engaging meaningfully with other people are critical aspects of human cognition. Multiple cognitive systems, including social and semantic cognition, work alongside each other to support these processes. This study investigated shared processing between social and semantic systems using neuroimaging data collected during movie-viewing, which captures the multimodal environment in which social knowledge is exchanged. Semantic and social content from movie events (event-level) and movie transcripts (word-level) were used in parametric modulation analyses to test (1) the degree to which semantic and social information is processed within each respective network and (2) engagement of the same cross-network regions or the same domain-general hub located within the semantic network during semantic and social processing. Semantic word and event-level content engaged the same fronto-temporo-parietal network and a portion of the semantic hub in the anterior temporal lobe (ATL). Social word and event-level content engaged the supplementary motor area and right angular gyrus within the social network, but only social words engaged the domain-general semantic hub in left ATL. There was evidence of shared processing between the social and semantic systems in the dorsolateral portion of right ATL which was engaged by word and event-level semantic and social content. Overlap between the semantic and social word and event results was highly variable within and across participants, with the most consistent loci of overlap occurring in left inferior frontal, bilateral precentral and supramarginal gyri for social and semantic words and in bilateral superior temporal gyrus extending from ATL posteriorly into supramarginal gyri for social and semantic events. These results indicate a complex pattern of shared and distinct regions for social and semantic cognition during naturalistic processing. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on October 11, 2022. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/ACWQY .

Phase synchronization during the processing of taxonomic and thematic relations.

Semantic relations include "taxonomic" relations based on shared features and "thematic" relations based on co-occurrence in events. The "dual-hub" account proposes that the anterior temporal lobe (ATL) is functionally specialized for taxonomic relations and the inferior parietal lobule (IPL) for thematic relations. This study examined this claim by analyzing the intra- and inter-region phase synchronization of intracranial EEG data from electrodes in the ATL, IPL, and two subregions of the semantic control network: left inferior frontal gyrus (IFG) and posterior middle temporal gyrus (pMTG). Ten participants with epilepsy completed a semantic relatedness judgment task during intracranial EEG recording and had electrodes in at least one hub and at least one semantic control region. Theta band phase synchronization was partially consistent with the dual-hub account: synchronization between the ATL and IFG/pMTG increased when processing taxonomic relations, and synchronization within the IPL and between IPL and pMTG increased when processing thematic relations.

Illuminating the daily life experiences of adolescents with and without ADHD: protocol for an ecological momentary assessment study.

INTRODUCTION: Adolescents with attention-deficit/hyperactivity disorder (ADHD) are at elevated risk of a range of difficulties, among which emotion regulation, peer and co-occurring mental health problems are prominent challenges. To better support adolescents with ADHD, ecologically valid interventions that can be embedded in daily life to target the most proximal antecedents of these challenges are needed. Ecological momentary assessment (EMA) designs are ideally suited to meeting this need. METHODS AND ANALYSES: In the mental health in the moment ADHD study, we will use an EMA design to capture the daily life experiences of approximately 120 adolescents aged 11-14 years with a clinical diagnosis of ADHD and the same number of age-matched and gender-matched peers without a diagnosis of ADHD. We will combine this with comprehensive information gathered from online surveys. Analysing the data using techniques such as dynamic structural equation modelling, we will examine, among other research questions, the role of emotion regulation and peer problems in mediating the links between characteristics of ADHD and commonly co-occurring outcomes such as anxiety, depression and conduct problems. The results can help inform interventions to support improved peer functioning and emotion regulation for adolescents with ADHD. ETHICS AND DISSEMINATION: This study received a favourable ethical opinion through the National Health Service ethical review board and the University of Edinburgh PPLS Research Ethics panel. The results will be disseminated through journal publications, conferences and seminar presentations and to relevant stakeholders, such as those with ADHD, their families and clinicians.

The words that little by little revealed everything: Neural response to lexical-semantic content during narrative comprehension.

The ease with which narratives are understood belies the complexity of the information being conveyed and the cognitive processes that support comprehension. The meanings of the words must be rapidly accessed and integrated with the reader's mental representation of the overarching, unfolding scenario. A broad, bilateral brain network is engaged by this process, but it is not clear how words that vary on specific semantic dimensions, such as ambiguity, emotion, or socialness, engage the semantic, semantic control, or social cognition systems. In the present study, data from 48 participants who listened to The Little Prince audiobook during MRI scanning were selected from the Le Petit Prince dataset. The lexical and semantic content within the narrative was quantified from the transcript words with factor scores capturing Word Length, Semantic Flexibility, Emotional Strength, and Social Impact. These scores, along with word quantity variables, were used to investigate where these predictors co-vary with activation across the brain. In contrast to studies of isolated word processing, large networks were found to co-vary with the lexical and semantic content within the narrative. An increase in semantic content engaged the ventral portion of ventrolateral ATL, consistent with its role as a semantic hub. Decreased semantic content engaged temporal pole and inferior parietal lobule, which may reflect semantic integration. The semantic control network was engaged by words with low Semantic Flexibility, perhaps due to the demand required to process infrequent, less semantically diverse language. Activation in ATL co-varied with an increase in Social Impact, which is consistent with the claim that social knowledge is housed within the neural architecture of the semantic system. These results suggest that current models of language processing may present an impoverished estimate of the neural systems that coordinate to support narrative comprehension, and, by extension, real-world language processing.

Behavioural and neural structure of fluent speech production deficits in aphasia.

Deficits in fluent speech production following left hemisphere stroke are a central concern because of their impact on patients' lives and the insight they provide about the neural organization of language processing. Fluent speech production requires the rapid coordination of phonological, semantic, and syntactic processing, so this study examined how deficits in connected speech relate to these language sub-systems. Behavioural data (N = 69 participants with aphasia following left hemisphere stroke) consisted of a diverse and comprehensive set of narrative speech production measures and measures of overall severity, semantic deficits, and phonological deficits. These measures were entered into a principal component analysis with bifactor rotation-a latent structure model where each item loads on a general factor that reflects what is common among the items, and orthogonal factors that explain variance not accounted for by the general factor. Lesion data were available for 58 of the participants, and each factor score was analysed with multivariate lesion-symptom mapping. Effects of connectivity disruption were evaluated using robust regression with tract disconnection or graph theoretic measures of connectivity as predictors. The principal component analysis produced a four-factor solution that accounted for 70.6% of the variance in the data, with a general factor corresponding to the overall severity and length and complexity of speech output (complexity factor), a lexical syntax factor, and independent factors for Semantics and Phonology. Deficits in the complexity of speech output were associated with a large temporo-parietal region, similar to overall aphasia severity. The lexical syntax factor was associated with damage in a relatively small set of fronto-parietal regions which may reflect the recruitment of control systems to support retrieval and correct usage of lexical items that primarily serve a syntactic rather than semantic function. Tract-based measures of connectivity disruption were not statistically associated with the deficit scores after controlling for overall lesion volume. Language network efficiency and average clustering coefficient within the language network were significantly associated with deficit scores after controlling for overall lesion volume. These results highlight overall severity as the critical contributor to fluent speech in post-stroke aphasia, with a dissociable factor corresponding to lexical syntax.

A registered re-examination of the effects of leftward prism adaptation on landmark judgements in healthy people.

It has long been known that active adaptation to a shift of the visual field, caused by laterally-displacing prisms, induces short-term sensorimotor aftereffects. More recent evidence suggests that prism adaptation may also stimulate higher-level changes in spatial cognition, which can modify the spatial biases of healthy people. The first reported, and most replicated, higher-level aftereffect is a rightward shift in the point of subjective equality (PSE) for a perceptual bisection task (the landmark task), following adaptation to leftward prisms. A recent meta-analysis suggests that this visuospatial aftereffect should be robustly induced by an extended period of adaptation to strong leftward prisms (15°, ∼26.8 prism dioptres). However, we have been unable to replicate this effect, suggesting that the effect size estimated from prior literature might be over-optimistic. This Registered Report compared visuospatial aftereffects on the landmark task for a 15° leftward prism adaptation group (n = 102) against a sham-adaptation control group (n = 102). The effect size for the comparison was Cohen's d = .27, 95% CI [-.01, .55], which did not pass the criterion set for significance. A Bayesian analysis indicated that the data were more than 4.1 times as likely under the null than under an informed experimental hypothesis. Exploratory analyses showed no evidence for a rightward shift of landmark judgements in the prism group considered alone, and no relationship between sensorimotor and visuospatial aftereffects. We further found no support for previous suggestions that visuospatial aftereffects are modulated by a person's baseline bias (leftward or rightward) for the landmark task. Null findings are also presented for a preliminary group of 62 participants adapted to 15° leftward prisms, and an additional group of 29 participants adapted to 10° leftward prisms. We do not rule out the possibility that leftward prisms might induce higher-level visuospatial aftereffects in healthy people, but we should be more sceptical about this claim.

Lesion correlates of auditory sentence comprehension deficits in post-stroke aphasia.

Auditory sentence comprehension requires coordination of multiple levels of processing: auditory-phonological perception, lexical-semantic comprehension, syntactic parsing and discourse construction, as well as executive functions such as verbal working memory (WM) and cognitive control. This study examined the lesion correlates of sentence comprehension deficits in post-stroke aphasia, building on prior work on this topic by using a different and clinically-relevant measure of sentence comprehension (the Token Test) and multivariate (SCCAN) and connectome-based lesion-symptom mapping methods. The key findings were that lesions in the posterior superior temporal lobe and inferior frontal gyrus (pars triangularis) were associated with sentence comprehension deficits, which was observed in both mass univariate and multivariate lesion-symptom mapping. Graph theoretic measures of connectome disruption were not statistically significantly associated with sentence comprehension deficits after accounting for overall lesion size.

Difficulty and pleasure in the comprehension of verb-based metaphor sentences: A behavioral study.

What is difficult is not usually pleasurable. Yet, for certain unfamiliar figurative language, like that which is common in poetry, while comprehension is often more difficult than for more conventional language, it is in many cases more pleasurable. Concentrating our investigation on verb-based metaphors, we examined whether and to what degree the novel variations (in the form of verb changes and extensions) of conventional verb metaphors were both more difficult to comprehend and yet induced more pleasure. To test this relationship, we developed a set of 62 familiar metaphor stimuli, each with corresponding optimal and excessive verb variation and metaphor extension conditions, and normed these stimuli using both objective measures and participant subjective ratings. We then tested the pleasure-difficulty relationship with an online behavioral study. Based on Rachel Giora and her colleagues' 'optimal innovation hypothesis', we anticipated an inverse U-shaped relationship between ease and pleasure, with an optimal degree of difficulty, introduced by metaphor variations, producing the highest degree of pleasure when compared to familiar or excessive conditions. Results, however, revealed a more complex picture, with only metaphor extension conditions (not verb variation conditions) producing the anticipated pleasure effects. Individual differences in semantic cognition and verbal reasoning assessed using the Semantic Similarities Test, while clearly influential, further complicated the pleasure-difficulty relationship, suggesting an important avenue for further investigation.

Intracranial EEG evidence of functional specialization for taxonomic and thematic relations.

The dual-hub account posits that the neural organization of semantic knowledge is segregated by the type of semantic relation with anterior temporal lobe (ATL) specializing for taxonomic relations and inferior parietal lobule (IPL) for thematic relations. This study critically examined this account by recording intracranial EEG from an array of depth electrodes within ATL, IPL, and two regions within the semantic control network, inferior frontal gyrus (IFG) and posterior middle temporal gyrus (pMTG), while 17 participants with refractory epilepsy completed a semantic relatedness judgment task. We observed a significant difference between relation types in ATL and IPL approximately 600-800 ms after trial presentation, and no significant differences in IFG or pMTG. Within this time window, alpha and theta suppression indexing cognitive effort and memory retrieval was observed in ATL for taxonomic trials and in IPL for thematic trials. These results suggest taxonomic specialization in ATL and thematic specialization in IPL, consistent with the dual-hub account of semantic cognition.

Shared lesion correlates of semantic and letter fluency in post-stroke aphasia.

Lesion-symptom mapping studies have reported a temporal versus frontal dissociation between semantic and letter fluency, and mixed evidence regarding the role of white matter. Mass-univariate and multivariate lesion-symptom mapping was used to identify regions associated with semantic and letter fluency deficits in post-stroke aphasia. Multivariate LSM revealed broad networks including underlying white matter, and substantial overlap between both types of fluency, suggesting that semantic fluency and letter fluency largely rely on the same neural system. All data are available on OSF.

Estimating effects of graded white matter damage and binary tract disconnection on post-stroke language impairment.

Despite the critical importance of close replications in strengthening and advancing scientific knowledge, there are inherent challenges to conducting replications of lesion-based studies. In the present study, we conducted a close conceptual replication of a study (i.e., Hope et al., 2016) that found that fluency and naming scores in post-stoke aphasia were more strongly associated with a binary measure of structural white matter integrity (tract disconnection) than a graded measure (lesion load). Using a different sample of stroke patients (N = 128) and four language deficit measures (aphasia severity, picture naming, and composite scores for speech production and semantic cognition), we examined tract disconnection and lesion load in three white matter tracts that have been implicated in language processing: arcuate fasciculus, uncinate fasciculus, and inferior fronto-occipital fasciculus. We did not find any consistent evidence that binary tract disconnection was more strongly associated with language impairment over and above lesion load, though individual deficit measures differed with respect to whether lesion load or tract disconnection was the stronger predictor. Given the mixed findings, we suggest caution when using such indirect estimates of structural white matter integrity, and direct individual measurements (for example, using diffusion weighted imaging) should be preferred when they are available. We end by highlighting the complex nature of replication in lesion-based studies and offer some potential solutions.

Relative contributions of lesion location and lesion size to predictions of varied language deficits in post-stroke aphasia.

Despite the widespread use of lesion-symptom mapping (LSM) techniques to study associations between location of brain damage and language deficits, the prediction of language deficits from lesion location remains a substantial challenge. The present study examined several factors which may impact lesion-symptom prediction by (1) testing the relative predictive advantage of general language deficit scores compared to composite scores that capture specific deficit types, (2) isolating the relative contribution of lesion location compared to lesion size, and (3) comparing standard voxel-based lesion-symptom mapping (VLSM) with a multivariate method (sparse canonical correlation analysis, SCCAN). Analyses were conducted on data from 128 participants who completed a detailed battery of psycholinguistic tests and underwent structural neuroimaging (MRI or CT) to determine lesion location. For both VLSM and SCCAN, overall aphasia severity (Western Aphasia Battery Aphasia Quotient) and object naming deficits were primarily predicted by lesion size, whereas deficits in Speech Production and Speech Recognition were better predicted by a combination of lesion size and location. The implementation of both VLSM and SCCAN raises important considerations regarding controlling for lesion size in lesion-symptom mapping analyses. These findings suggest that lesion-symptom prediction is more accurate for deficits within neurally-localized cognitive systems when both lesion size and location are considered compared to broad functional deficits, which can be predicted by overall lesion size alone.

Differential recruitment of theory of mind brain network across three tasks: An independent component analysis.

Social neuroscience research has focused on an identified network of brain regions primarily associated with processing Theory of Mind (ToM). However, ToM is a broad cognitive process, which encompasses several sub-processes, such as mental state detection and intentional attribution, and the connectivity of brain regions underlying the broader ToM network in response to paradigms assessing these sub-processes requires further characterization. Standard fMRI analyses which focus only on brain activity cannot capture information about ToM processing at a network level. An alternative method, independent component analysis (ICA), is a data-driven technique used to isolate intrinsic connectivity networks, and this approach provides insight into network-level regional recruitment. In this fMRI study, three complementary, but distinct ToM tasks assessing mental state detection (e.g. RMIE: Reading the Mind in the Eyes; RMIV: Reading the Mind in the Voice) and intentional attribution (Causality task) were each analyzed using ICA in order to separately characterize the recruitment and functional connectivity of core nodes in the ToM network in response to the sub-processes of ToM. Based on visual comparison of the derived networks for each task, the spatiotemporal network patterns were similar between the RMIE and RMIV tasks, which elicited mentalizing about the mental states of others, and these networks differed from the network derived for the Causality task, which elicited mentalizing about goal-directed actions. The medial prefrontal cortex, precuneus, and right inferior frontal gyrus were seen in the components with the highest correlation with the task condition for each of the tasks highlighting the role of these regions in general ToM processing. Using a data-driven approach, the current study captured the differences in task-related brain response to ToM in three distinct ToM paradigms. The findings of this study further elucidate the neural mechanisms associated with mental state detection and causal attribution, which represent possible sub-processes of the complex construct of ToM processing.

Brain Mechanisms Underlying Reading the Mind from Eyes, Voice, and Actions.

Evidence from cognitive and social neuroscience research suggests that Theory of Mind (ToM), the ability to attribute mental states to others, is mediated by a group of brain regions collectively known as the ToM network. Nevertheless, there is significant variability in the functional activation of regions within this network across tasks. The goal of the present functional magnetic resonance imaging (fMRI) study was to examine the common and differential neural mechanisms of two aspects of ToM processing (emotion/mental-state recognition and intentional attribution) using three distinct, but complementary ToM tasks (Reading the Mind in the Eyes (RMIE), Reading the Mind in the Voice (RMIV), and Intentional Causal Attribution) in healthy adults. Participant accuracy was significantly worse in the ToM compared to the control condition across all tasks. Brain activation analyses replicated previously reported activation in inferior frontal gyrus (IFG) and middle temporal gyrus extending to posterior superior temporal sulcus (pSTS) in RMIE. Activation in the fusiform gyrus and bilateral middle temporal gyrus extending to temporo-parietal junction (TPJ) was unique to causality task. A region-of-interest analysis revealed shared activation in left IFG for RMIE and RMIV as well as TPJ recruitment specific to the causality task. The role of right TPJ in the causality task was further supported by a percent signal change analysis. A conjunction analysis revealed overlap in left IFG, left precentral gyrus, and left superior frontal gyrus activity across all tasks. These findings highlight common and differential recruitment of ToM regions according to task demand.

The impact of atypical sensory processing on social impairments in autism spectrum disorder.

Altered sensory processing has been an important feature of the clinical descriptions of autism spectrum disorder (ASD). There is evidence that sensory dysregulation arises early in the progression of ASD and impacts social functioning. This paper reviews behavioral and neurobiological evidence that describes how sensory deficits across multiple modalities (vision, hearing, touch, olfaction, gustation, and multisensory integration) could impact social functions in ASD. Theoretical models of ASD and their implications for the relationship between sensory and social functioning are discussed. Furthermore, neural differences in anatomy, function, and connectivity of different regions underlying sensory and social processing are also discussed. We conclude that there are multiple mechanisms through which early sensory dysregulation in ASD could cascade into social deficits across development. Future research is needed to clarify these mechanisms, and specific focus should be given to distinguish between deficits in primary sensory processing and altered top-down attentional and cognitive processes.